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ABSTRACT 



We have measured the distribution function of the flux decrement D = e"'^ 
caused by Lya forest absorption from intervening gas in the lines of sight 
to high redshift QSOs from a sample of seven high resolution QSO spectra 
obtained with the Keck telescope. The observed flux decrement distribution 
function (FDDF) is compared to the FDDF from two simulations of the Lya 
forest: a ACDM model (with J7 =0.4, A=0.6) computed with the Eulerian 
code of Cen & Ostriker, and a standard CDM model (SCDM, with 9. = I) 
computed with the SPH code of Hcrnquist, Katz, &: Weinberg. Good agreement 
is obtained between the shapes of the simulated and observed FDDFs for 
both simulations after fitting only one free parameter, which controls the 
mean flux decrement. The difference between the predicted FDDFs from the 
two simulations is small, and we show that it arises mostly from a different 
temperature in the low-density gas (caused by different assumptions that 
were made about the reionization history in the two simulations), rather than 
differences between the two cosmological models per se, or numerical effects in 
the two codes which use very different computational methods. 

A measurement of the parameter ^ oc flfh^/F (where T is the HI ionization 
rate due to the ionizing background) is obtained by requiring the mean flux 
decrement in the simulations to agree with the observed one. Estimating the 
lower limit F > 7 x 10"^^ s~^ from the abundance of known QSOs, we derive a 
lower limit on the baryonic matter density, 0(,/i^> 0.021(0.017) for the ACDM 
(SCDM) model. The difference between the lower limit inferred from the two 
models is again due to different temperatures in the low-density gas. We give 
general analytical arguments for why this lower limit is unlikely to be reduced 
for any other models of structure formation by gravitational collapse that can 
explain the observed Lya forest. The large Qfy we infer is inconsistent with 
some recent D/H determinations (Rugers & Hogan 1996a, b), favoring a low 
deuterium abundance as reported by Tytler, Fan &; Buries (1996). Adopting 
a fixed ^b, the measurement of fj,{z) allows a determination of the evolution 
of the ionizing radiation field with redshift. Our models predict an intensity 
that is approximately constant with redshift, which is in agreement with the 
assumption that the ionizing background is produced by known quasars for 
z < 3, but requires additional sources of ionizing photons at higher redshift 
given the observed rapid decline of the quasar abundance. 
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1. Introduction 

The mean baryon density of the universe is one of the observationaUy most relevant 
cosmological parameters. It influences the whole range of observable baryonic structures, 
from the abundances of primordial nuclei to the observational appearance of the large-scale 
distribution of intergalactic gas and galaxies. At the same time, the value of flf, is a 
testable prediction of the Standard Big Bang model. Using the theory of primordial 
nucleosynthesis in the early universe we can compute the abundances for the primordial 
gas as a function of only one parameter, the cosmic baryon density. Consequently, can 
be inferred from the measured abundances of the light elements (e.g.. Walker et al. 1991). 
The agreement of the various abundances with observations has long been held as one of 
two most important successes of the Big Bang theory (the other one being the prediction 
of the CMB). Recently, attempts have been made to measure ilf, from the deuterium 
abundance in high-redshift QSO absorption systems (e.g., Songaila et al. 1994; Carswcll 
et al. 1994; Tytler, Fan, & Buries 1996; Buries & Tytler 1996; Rugers & Hogan 1996a,b). 
These observations exploit the fact that the D/H ratio is highly sensitive to the baryon 
density. The absorbing gas clouds have low metallicity, so the deuterium abundance should 
reflect the primordial value and not be excessively affected by stellar processing. The 
interpretations of these observations are currently subject to discussion and at the time of 
writing there is no agreement among different groups about the value of the deuterium 
abundance. 

The predictions of primordial nucleosynthesis would be much more impressive if 
there were an independent method to measure O^t, and it was found to agree with the 
value required by the abundances of the light elements. In the long run, the best 
independent measurements may come from observations of the spectrum of fluctuations 
in the microwave background, which can yield 0,^ from the amplitude of the peak caused 
by acoustic waves (Holtzman 1989; Jungman et al. 1995), as well as other cosmological 
parameters. 

Another possible approach involves counting baryons more "directly" by adding up 
the contribution to the mean cosmic density from all classes of known astronomical objects. 
Until now such work has been limited to low redshift objects, such as galaxies and galaxy 
clusters (e.g. Persic & Salucci 1992; Bristow & Phillips 1994). An unknown fraction of the 
dark matter known to exist in galaxy halos and clusters of galaxies could be of baryonic 
origin, and baryons may also hide in the intergalactic medium or in low surface brightness 
galaxies, where even their gravitational influence is hard to detect. Thus, only a lower 
limit to the baryon density is obtained from such an inventory of observed baryons. 

If we had a complete theory of how the baryons have been distributed over various 
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classes of astronomical objects at different epochs, as structure in the universe developed, 
we could in principle predict the cosmic density of baryons from the measurement of only a 
single tracer of baryonic matter. Observations of highly evolved virialized objects (galaxies 
and clusters) may not be ideal candidates for such measurements, owing to the theoretical 
uncertainties in the fraction of the total mass they contain, and in the fate of the baryons 
which accreted onto these systems. Here we shall instead consider observations of gas in 
regions of much lower densities outside virialized objects, which probably have a more 
simple history. Hydrodynamic simulations of increasing resolution allow us to calculate the 
evolution of this cosmologically distributed gas from initial perturbations down to redshifts 
accessible to observations, for different cosmological models. 

The only way to observationally study the gas at such low densities is by measuring 
resonance line absorption imprinted on the spectrum of a background light source. This 
phenomenon was first observed as the so-called Gunn-Peterson effect (Gunn k, Peterson 
1965): the increasingly redshifted Lya absorption from intervening gas in the line-of-sight 
to a QSO causes an apparent absorption trough blueward of the Lya emission line. At 
high spectral resolution the optical depth for Lya absorption is seen to fluctuate sharply, 
giving rise to the observational phenomenon of the Lya forest (Lynds 1971). The gaseous 
structures underlying the Lya forest have often been visualized as discrete gas clouds 
producing the absorption lines, embedded in a low density, distinct "intercloud medium" 
that might cause a residual Gunn-Peterson absorption trough. However, in a hierarchical 
structure formation picture where the Lya forest originates in gravitational collapse, the 
photoionized gas occupies a continuous, wide range of densities and pressures as it accretes 
towards various structures, and there is no distinction between a Gunn-Peterson effect and 
Lya forest absorption (Bi 1993; Reisenegger &; Miralda-Escude 1995; Hernquist et al. 1996; 
Miralda-Escude et al. 1996; Croft et al. 1997; Bi & Davidsen 1997). 

It is easy to see how the strength of the Gunn-Peterson effect must depend on the 
baryon density and the photoionization rate. The optical depth r of HI Lya absorption in 
a quasar spectrum is proportional to the neutral hydrogen column density and inversely 
proportional to the velocity interval over which the gas is spread, r oc dNm/dLV (e.g. 
Spitzer 1978). The neutral hydrogen density is in turn proportional to r^-'^a(T)n^. for 
highly ionized gas dominated by photoionization. Here uhi and n are the neutral hydrogen 
and the total gas density, a(T) is the recombination coefficient, and 



is the photoionization rate due to the background radiation with mean intensity J(z^). A 
clumpy gas with overdensity p/p and temperature T, expanding with the Hubble flow, and 
subject to peculiar motions with velocity fpec(^) along the line-of-sight, causes absorption 




(1) 
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with an optical depth 

where Hq is the present Hubble constant, and H(z) is the Hubble constant at redshift z 
(ignoring here the effects of thermal broadening). For a universe homogeneously filled 
with hydrogen gas {p/p = 1) expanding isotropically without peculiar motions (I'pec = 0) 
we retrieve the original expression for the Gunn-Peterson optical depth (Gunn & Peterson 
1965). But in a clumpy universe, and because the observed flux decrement D = e"'^ is 
extremely sensitive to the overdensity, the overdense regions with r ^ 1 can appear as 
distinct absorption lines, while most of the spectrum between these lines contains only 
very weak absorption features (corresponding to low-density gas filling most of the volume 
in the universe), which are difficult to detect in the presence of noise. 

Hydrodynamical simulations of structure formation can be used to generate simulated 
spectra as would be seen on a source placed behind the simulated region of the universe, 
given the peculiar velocities, temperatures, and densities in the absorbing gas (Cen et al. 
1994; Zhang et al. 1995, 1996; Hernquist et al. 1996; Miralda-Escude et al. 1996, 1997). 
From a large number of simulated spectra we can calculate the distribution of the optical 
depth, or the flux decrement D = e^'^ . From equation (2), we sec that once the gas 
overdensity, temperature and velocity fields are fixed, only the normalization of the optical 
depth r in the spectra can be changed depending on the following parameter: 

_ / V / 100kms-^Mpc-i\ / 1 

1^0.0125 J H{^) )\f^ 

Here we have used h = iJo/lOOkms"-*^ Mpc""^, r_i2 = r/(10~-'^^ sec), and the redshift 
dependent Hubble constant 

Hiz) = lOO/ikms"^ Mpc'i 

where is the total density in units of the critical density, and A is the contribution from 
the cosmological constant. All cosmological parameters without explicit z dependence are 
given for z=0. 

The parameter /i can be estimated by fitting the mean flux decrement from the 
simulations to the mean flux decrement of the Lya forest observed in QSO spectra. Once 
this parameter is fixed, the shape of the flux decrement distribution can be used to 
observationally test the model. 




0(1 + zf + {1 - n - A){1 + zf + A 



(4) 
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Note that the scaling of optical depths with fi assumes that the gas temperatures, 

densities, and velocities do not change with Qi,h'^, Hq, or r_i2, a point that we will return 
to in our later discussion. The optical depth is also proportional to the term [H{z)]^^ in 
equation (2), although a change in the Hubble constant implies a change in the power 
spectrum of the initial density fluctuations in the cosmological model as well. 

Thus, if we possess an independent estimate of the strength of the ionizing radiation 
field, we can derive the value of fi^ required to reproduce the observed mean Lja absorption 
for a given cosmological model. If that cosmological model accurately reproduces the 
other observed properties of the Lja forest, such as the column density and Doppler 
parameter distributions and the distribution of the flux decrement, then we can reasonably 
suppose that the eff'ects of the overdensities and peculiar velocities in equation (2) have 
been adequately incorporated for the purpose of estimating the parameter even if the 
cosmological model we use is not precisely the true representation of the universe. 

The use of the Lya forest as a tracer of the baryons in the universe has the advantage 
that the fraction of baryons present in the Lya forest is predicted by the adopted 
cosmological model. Although there are still uncertainties related to the fraction of 
baryons that may have turned into stars at epochs earlier than the time when the Lya 
forest is observed, this fraction is expected to be small (e.g., Couchman & Rees 1986). It 
is reassuring that at redshifts > 2 most of the baryons are expected to reside in low and 
intermediate column density condensations according to the simulations and that this is 
consistent with the observations we have, so the Lya forest is not only a tracer but the 
dominant reservoir of baryons (Ranch &; Haehnelt 1995; Miralda-Escude et al. 1996, 1997). 

In this paper we compare the observed distribution of the flux decrement D from a new 
large dataset from the Keck telescope to the predictions of two hydrodynamical simulations 
of the Lya forest. The first is the Eulerian simulation of a cold dark matter (CDM) model 
with a cosmological constant (ACDM, with J7 = 0.4, A = 0.6, Hq = 65kms~^ Mpc~^, 
as = 0.79, and box size L = Whr^ Mpc) analyzed by Ccn ct al. (1994) and Miralda-Escude 
et al. (1996). This model assumes a primordial power spectrum with an asymptotic slope 
n = 0.95 on large scales, and it is normalized to the COBE-DMR microwave background 
fluctuation amplitude. The second simulation is the smoothed particle hydrodynamics 
(SPH) simulation of the "standard" CDM model (SCDM, with O = 1, A = 0, erg = 0.7, 
Ho = 50kms"^ Mpc"\ and box size L = ll.l/i"^ Mpc) analyzed by Croft et al. (1997), 
which is similar to the one presented in Hcrnquist ct al. (1996) and Katz et al. (1996) but 
includes star formation and a more realistic spectrum for the ionizing background. This 
model has n = 1 on large scales, but the as normalization, chosen to yield a reasonable 
match to observed cluster masses, is only about 60% of the normalization implied by 
COBE-DMR for these cosmological parameters. 
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We measure the parameter ^ by scaling the optical depth in the simulations so that 
the mean flux decrement D agrees with the observed D at diff'crcnt rcdshifts. We then 
derive a lower limit to the ionization rate F by requiring tliat T is at least as high as 
the number of ionizations caused by the ionizing radiation field from the known QSOs. 
Prom this a lower limit to U},h^^'^ is obtained. Furthermore, from the redshift variation of 
the above parameter, we infer the redshift dependence of F which is consistent with each 
simulated cosmological model. 

Section 2 describes the procedure we used to determine the flux decrement distribution 
function from the observations. Section 3 presents the comparison between data and 
simulations, and the scaling of the optical depth necessary to obtain agreement between 
them, and Section 4 derives a lower limit for the intensity of the ionizing background. 
In section 5 we discuss the consequences for and for the evolution of the ionizing 
background, and in Section 6 we summarize our conclusions. 

2. The observed distribution of flux decrements 

The flux decrement distribution function (FDDF) was computed from a set of 7 QSO 
spectra (described in Table 1) observed with the high resolution spectrograph (HIRES) 
on the Keck telescope. The nominal velocity resolution was 6.6 kms"-*^ (FWHM), and 
the data were rebinned onto 0.04 A pixels on a linear wavelength scale. The data were 
reduced as described by Barlow & Sargent (1997). Continua were fitted to regions of 
the spectra judged to be apparently free of absorption lines using spline functions. A 
three-sigma rejection algorithm was used to eliminate statistically significant depressions 
from the fitting regions. The number of knots used between the splines was dependent on 
the signal-to-noisc and redshift of the data. In the case of z > 4 data only a relatively 
crude low order polynomial with very few fitting points could be used due to the lack of 
unabsorbed regions in the QSO spectrum (with the corresponding large uncertainties in 
the absolute continuum level). 

We are interested in the distribution of optical depths for the Lyman a A1215.67 A 
absorption line, so only those regions of a spectrum between the QSO's Ly/3 and Lya 
emission were considered, to avoid confusion with the Ly/? forest. In addition, spectral 
regions within 5 Mpc from each QSO's emission redshift were omitted to avoid 
contamination of the data sample by the proximity effect (e.g., Bajtlik, Duncan, & Ostriker 
1988; Lu, Wolfe, & Turnshek 1991). The contribution by metal lines to the opacity in the 
Lya forest turned out to be substantial in the low redshift (z <2.5) forest, amounting to 
22% of the total flux decrement at z~ 2, so the spectra had to be cleared of heavy element 
absorption lines and damped Lya lines. Experience shows that the overwhelming majority 
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Table 1: QSO Spectra Used 



QSO 




m 


Q2343+123 


2.52 


17 


Q1442+293 


2.67 


16.2 


Q1107+485 


3.00 


16.7 


Q1425+604 


3.20 


16.5 


Q1422+230 


3.62 


16.5 


QOOOO— 262 


4.11 


17.5 


Q2237— 061 


4.55 


18.3 



of absorption lines with a "narrow" appearance (Doppler parameter less than ~ 15kms~ ) 
can be attributed to transitions of ions other than HI. Many of these lines can be identified 
from other easily recognizable lines at the same redshifts, redward of Lya emission, but 
obviously there has to be residual contamination by systems at lower z (dominated by weak 
CIV systems) where most detectable lines are buried in the Lya forest. Thus, whenever 
there was an unidentified strong and narrow (6 < lOkms"^) line in the forest it was cut 
out as well. This approach is not totally satisfactory because weak metal lines will still be 
left unidentified, but their contribution to the opacity should be very small. On the other 
hand, there could also be some narrow hydrogen lines that are mistakenly removed as 
metal systems, but again we expect the contribution from any such lines to be negligible. 
With increasing redshift such residual errors decrease in importance as the average opacity 
of the Lya forest increases rapidly, leading to increasing blanketing of any unidentified 
metal lines while the strength (at least of the higher ionization) metal lines decreases. 

The spectral regions surviving the selection were split into redshift bins ranging 
between 2;=1.5 and 2;=4.5, in 3 steps of Az =1.0. To compare with the existing simulations 
the nominal central redshifts were chosen to be 2.0, 3.0, and 4.0, but the actual mean 
redshifts for the pixels used when computing the FDDF were < z > = 2.29, 3.02, and 
3.98, respectively. The discrepancy for the z = 2 bin results from a lack of low z data in 
our sample, due to the low sensitivity of the Keck HIRES instrument at wavelengths close 
to the atmospheric cutoff. At Az = 1, the redshift bins chosen are rather wide and the 
mean redshift is obviously not always centered on the middle of the bin, so evolution of 
the optical depth within each bin may cause problems when comparing to spectra from a 
simulation at a fixed redshift. The evolution of the optical depths from a freely expanding 
homogeneous medium in a flat universe should follow r oc (1 + z)^-^. Consequently, we 
have corrected the observed optical depths within each bin by scaling them according to 
r oc (1 + zY'^ to the values they would have at the central redshift of the bin. The mean 
redshift for each bin, the original observed mean flux decrement D, and the corresponding 
value after correction for the finite redshift range D'^'^* are given in columns 2, 3, and 4 of 



0.2 0.4 0.6 0.8 1 

flux decrement D = 1 — flux 

Fig. 1. — The cumulative flux decrement distribution function (FDDF), for the raw data (dash- 
dotted lines), and after a correction for the evolution of the optical depth between the measured 
redshift and the fiducial redshift (center of redshift bin) has been applied (solid line). 

Table 2. 

The FDDF was computed for each spectrum and each redshift bin separately. Then 
the contributions from the 7 different spectra were used to compute a weighted mean, 
where the median flux variance of each spectrum i divided by the number of pixels 
contributing to the individual distribution, (y'^^^j^ii) / Npix{i) ■, was used as a weighting factor 
in the usual sense, i.e., the contribution to the FDDF from a given spectrum was weighted 
in favor of spectral regions with high average pixel signal-to-noise ratios and with many 
pixels in the right wavelength range. This procedure was necessary as the spectra differed 
widely in wavelength coverage and in the average S/N ratio. 

The resulting cumulative flux decrement distribution is shown in Figure |. The 
FDDF for the raw data are represented by dash-dotted lines, and the distributions for 
the corrected optical depths are given by solid lines. Only the z = 2 bin is changed 
significantly by the evolution correction, because of the lack of low z pixels in that bin 
(see above). The extent of the distributions below D = {) and above D = 1 \s due to the 
finite signal-to-noise ratio in the data, with the bluer {z = 2) curve having a flatter slope 
at these values because of the higher noise level in the data. 
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3. Comparison between observations and simulations 

3.1. Corrections applied to the simulated spectra 

In order to measure the parameter fj, we choose to match a single nmnber, the mean 
flux decrement D, between observed data and simulations, by scaling the optical depth by 
a constant factor. The assumption we make here is that, had we repeated the simulations 
with different values of and T, the results would have been identical except for a 
constant rescaling of the optical depth at all points in the simulated spectra. Changing 
flh and r affects the cooling rates, photoionization heating rates, and self-gravity of the 
gas, but most of the Lya forest absorption arises in diffuse regions where the structure 
of the gas distribution is determined by the gravitational potential of the underlying 
dark matter. Changing 0^ can systematically alter the temperature of this diffuse gas by 
changing the photoionization heating rate, but although this effect alters the index in the 
relation r oc il^, the effect on the optical depth distribution is still very close to a simple 
rescaling (see Croft et al. 1997). We also assume that the neutral fraction in equilibrium is 
proportional to the gas density, which is true if collisional ionization is unimportant and the 
gas is highly photoionized. While collisional processes are not negligible for high density 
regions, these produce absorption with very high optical depth (i.e., strongly saturated 
absorption lines) where changes in the optical depth do not affect the flux decrement 
noticeably. Thus the assumption of a linear scaling of the optical depth with fi (underlying 
eq. [^) should be a good approximation. We have used this linear scaling on simulated 
spectra extracted from the two cosmological simulations described in §1. The pre-scaled 
spectra in the ACDM model were generated assuming T = 0.434 x 10~^^sec~^, although 
the cosmological simulation was run with a higher F depending on redshift, as described 
in Miralda-Escude et al. (1996). The SCDM model was run with the photoionizing 
background computed by Haardt & Madau (1996) for qq = 0.5, but reduced in intensity 
by a factor of two at each redshift (see Croft et al. 1997). 

In estimating the parameter n from the two simulations, an additional problem arose 
from the fact that the fltting formulae for the recombination coefficient that had been used 
in the analysis were different in the Eulerian and the SPH simulation. When running the 
numerical simulations, the accuracy of these formulae was not of great concern because it 
did not significantly affect the physical evolution of the gas. But of course, the neutral 
fraction that is calculated for fixed physical density and temperature is proportional to 
the recombination coefficient, and therefore the parameter that is inferred is inversely 
proportional to the recombination coefficient that is used. So, for the problem of deriving 
the /i parameter needed to adjust the flux distribution from the simulations to the observed 
one, it is important to use a recombination coefficient as accurate as possible. The results 
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of the most recent calculations for a{T) were given by Abel et al. (1996), and in the 

range 3 x 10^ K < T < 3 X lO^K (the relevant range for the gas that contributes to the 
unsaturated regions of the spectra), it is given by a{T) = 4.2 x 10^^^(T/10^ K)^*^''^ cm^s~^ 
to within 3%. The values of a(T) used for the Eulerian (SPH) simulation differed from 
the formula of Abel et al. (1996) by factors of 0.95 (1.20), which remain almost constant 
over the same temperature interval. Therefore, to correct for the slight inaccuracy in the 
recombination coefficients that had been used, we simply divided the inferred values of fi 
by these factors for the two simulations. More accurate expressions for the coefficients 
determining the ionization will be incorporated in the future in the numerical simulations, 
but the correction made here should be sufficiently accurate for our purpose of determining 
II. 

We now describe the corrections that were applied to the observational data in order 
to do the comparison of the flux distribution with the simulated spectra. Real data suffer 
from observational biases and errors that are not present in idealized simulated spectra. 
The effects of noise, instrumental resolution, and uncertainties in the continuum level in 
the observed data must either be taken out or imposed in a similar way on the simulated 
spectra. In practice, "degrading" the simulated spectra is usually easier. 

The first and most important problem arises from our ignorance about the precise 
placement of the QSO continuum against which the absorption optical depth is to be 
measured. The usual manual fitting methods with multiple splines or other high order 
polynomials tend to systematically underestimate the zeroth or first order contribution to 
the continuum, resulting in an underestimate of the number of pixels at low flux decrement. 
Moreover, at z > 3.5 there appear to be very few pixels left where the flux reaches up 
to the continuum within the noise uncertainty (as is indeed expected to happen from the 
simulated spectra), making the flux distribution within 10-15% of the true continuum 
even more uncertain. Here we have adopted the very simple approximation of choosing 
the highest flux value in each individual simulated spectrum (of length determined by 



Table 2. Observed and Corrected Flux Decrements 



[zuZ2] z D 5^«p;(ACDM) 5^«p;(SCDM) Dprs Dzl 



1.5 - 2.5 2.29 0.186 0.148 0.152 0.154 0.15 0.08 

2.5 - 3.5 3.02 0.321 0.316 0.330 0.345 0.36 0.22 

3.5 - 4.5 3.98 0.539 0.543 0.586 0.617 0.62 0.63 
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the size of the comoving periodic box of the cosmological simulation) as the value of the 
continuum, normalizing the spectra by dividing through this value. Although there may 
be more accurate ways to correct for the continuum fitting, the detailed process by which 
the continuum is obtained is very complex to reproduce, and it would require us to obtain 
longer simulated spectra than we have available from the simulation. We have therefore 
adopted this simple method because it should at least give an upper limit to the effect 
of continuum fitting on the measurement of D, since the intervals that are fitted in the 
observed spectra tend to be longer than the simulated spectra. 

To estimate the magnitude of the bias in D introduced when lowering the continuum 
to the maximum flux level in each spectrum, we have also computed the mean flux 
decrement for the models when retaining their original continuum. The difference between 
D derived for the two different continuum settings can be used to predict a correction 
for the actually observed D, in the sense that the "true" observed D would have been 
larger if we had known the position of the true continuum a priori. Thus, we define the 
corrected, mean decrement -D^^"* as the value of L**^*^"* in the idealized simulated spectra 
once the parameter /7, is chosen to make the value of D^^"^^ of the degraded, continuum 
normalized spectra match the observed values. It represents our best estimate of the true 
mean decrement assuming that the simulations give a realistic representation of the optical 
depth structure of the IGM. The continuum bias corrections are larger for the SCDM 
model compared to the ACDM model, because, as we shall soon show, the former model 
has more low optical depth absorption. The observed flux decrement corrected this way, 

is given in columns 5 and 6 of Table 2 for the two models. These values are in good 
agreement with the results obtained by Press, Rybicki, & Schneider (1993, PRS) with a 
different method for a large sample of low resolution QSO spectra, given for comparison in 
the last but one column of Table 2. However, the two lower z bins differ quite substantially 
from the results of the analysis by Zuo &; Lu (1993) (last column of Table 2), who find 
much less absorption at low redshift. 

The amount and distribution of noise is another important parameter, critically 
determining the shape of the FDDF close to the continuum level (Dps 0) and zero 
level (D~ 1). The total noise distribution of the real data is highly variable and not 
necessarily close to any analytical shape. There are many reasons for this, the most 
important one being that the spectra are a patchwork of individual exposures, taken 
under variable conditions, convolved with a strongly varying sensitivity function of the 
spectrograph. Rather than attempting a detailed modeling of the noise distributions and 
a decomposition into signal-dependent and -independent noise, we have added noise to 
the simulations in the following way: we take the noise variance arrays from the real data 
and construct, for every observed spectrum and every flux level (in steps of 5%), the 
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Fig. 2. — Cumulative distribution of noise standard deviations for the real data (solid line) and as 
derived from the simulated spectra (dashed lines) of the ACDM model after applying the procedure 
described in the text. 



probability function for the noise variance. We treat these functions statistically like the 
actual flux distribution functions for the data (when forming weighted means), to obtain 
the resulting noise probability function as a function of flux level. Then we add noise 
consistent with the variances drawn from these probability functions to the simulated 
data, using the appropriate distribution for each pixel with a given flux level. This gives 
an error distribution for the simulated data very close to the real data, the only difference 
being that the spatial correlation of the noise is of course lost, which is irrelevant for the 
purpose of computing the flux distribution only. Thus a pixel with flux decrement D in 
the simulated data has the same noise standard deviation as a pixel with the same flux in 
the real data. Fig. ^ shows that the distribution of the noise amplitudes retrieved from the 
simulations (here as an example from the ACDM simulation) after applying this procedure 
(dashed lines) is in excellent agreement with the distribution of the noise in the real data 
(solid line). This is simply because the flux distribution of the simulated spectra is very 
close to the observed one, as we shall see later. 

One additional correction has to be made for the smoothing introduced when rebinning 
during the data reduction. The actual fluctuation in the data was typically between 10 and 
40% smaller than indicated by the error array produced from the photon numbers right 
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Fig. 3. — The cumulative flux decrement distribution function (FDDF), for the real data corrected 

for r evolution as described in the text (solid lines), and for simulated spectra (dotted lines) from 
the ACDM simulation where the optical depth t has been scaled globally by the amounts given in 
Table 2. The simulated spectra have had noise added and the continuum changed as described in 
the text. 

at the beginning of the data reduction before any smoothing had occurred. Therefore, to 
make the simulated spectra look the same as the real data, the noise fluctuations from the 
probability distribution functions were reduced by suitable factors taken from a comparison 
of the rms fluctuations and the error array in sample stretches of the real data. As a 
result the slopes of the FDDFs are weU matched at both ends, although some discrepancy 
remains at the ~ end because of residual problems with the continuum level. 

The simulated spectra were also convolved with the instrumental profile, which is a 
Gaussian with FWHM= 6.6kms~^, before the noise was added. This convolution has 
a very small effect because all the features appearing in the simulated spectra are well 
resolved at this resolution. 
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Fig. 4. — The same diagram as before, but now for the SCDM simulation. 

3.2. Results 

Figure ^ shows the FDDF for the ACDM simulation (dotted line) overlaid on the 
observed distribution (solid line). The results for the SCDM simulation are given in Fig. 
^, also compared with the observed distribution. The agreement with observations is quite 
good in both cases, given that it is the result of a one-parameter fit (/i). This agreement 
(together with the other characteristics of the absorption lines that were found to agree 
reasonably with observations as reported in previous papers) suggests that the theories 
of hierarchical structure formation assumed in the cosmological simulations provide us 
with an accurate physical picture of the Lya forest. There are differences in detail in 
the predictions from these two cosmological models. In Figure I, the true FDDF of the 
SCDM and ACDM models are plotted (i.e., before any corrections are made for the effects 
of noise and continuum fitting), which allows us to compare the two models directly 
without the alterations needed for comparison to the observational data. There is indeed 
a small difference in the shape of the FDDF for the two models considered here: the 
SCDM simulation has a larger contribution to the average flux decrement from regions 
of low optical depth, compared to the ACDM model. Visual examination of Figures ^ 
and ^ indicates that the ACDM simulation fits the observations somewhat better than the 
SCDM simulation, though assigning quantitative statistical significance to this difference 



0.2 0.4 0.6 0.8 1 

flux decrement D = 1 — flux 

Fig. 5. — Comparison between the shapes of the FDDFs for the ACDM (dotted hne) and SCDM 
(sohd hne) simulations, now for the raw spectra with the original continuum level and no noise 
added. The r scaling is unchanged from the previous two figures. 

will require a detailed examination of random and systematic errors in the FDDF that is 
beyond the scope of this paper. 

What are the main characteristics of the gas distribution in the numerical simulations 
that determine the resulting FDDF in the simulated spectra? From equation (2), the 
optical depth distribution must be a function of the distributions in overdensity and 
temperature of the gas, as well as the effects that the peculiar velocity and thermal 
broadening have in redistributing the optical depth from different spatial regions in the 
observed spectra. The optical depth is highly sensitive to the overdensity; since the 
overdensity is also distributed over a very wide range, we expect that the distribution of 
overdensities will be most important in determining the distribution of optical depths. In 
fact, as shown in Miralda-Escude et al. (1996, 1997), the column density of absorption lines 
is mostly determined by the overdensities of the intercepted structures. Given that the 
column density distribution of the absorption lines agrees with the observed one, it is then 
not too surprising that good agreement is found also in the distribution of optical depths. 

Therefore, one reason for the difference between the two models seen in Figure ^ 
might be that the SCDM model has a higher fraction of the gas in low density regions. 
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Fig. 6. — The distribution of gas densities pb (in units of the mean gas density) at 2; = 2 for the 
SCDM simulation (soUd Une) and the ACDM simulation (dotted line). 

giving rise to optical depths r ~ 0.2, and a correspondingly lower fraction of gas in more 
overdense regions that produce strong absorption lines (r ^ 0.7). The volume- weighted 
density distribution is plotted in Figure 6 for the two models, at 2; = 2. 

The difference in the density distributions is very small, with the ACDM model having 
a slightly lower dispersion in the overdensity. This small difference has the wrong sign to 
explain the difference in the FDDF: the smaller the dispersion in overdensities, the larger 
the contribution to the mean decrement from unsaturated regions rather than strong 
absorption lines. 

A second possible cause for the difference is the temperature of the photoionized 
gas. The temperature affects the optical depth through the value of the recombination 
coefficient, which is approximately proportional to T~°-^ in the range of interest. The 
median temperature of the gas as a function of the overdensity is shown for the two models 
at z = 2 in Figure 7. At high overdensities, the temperature is determined by shock-heating 
due to collapse of structure, and the two simulations have similar temperatures. However, 
the temperatures are different at low overdensities. 

The reason for this difference in temperature is that, in the low density regions, the gas 
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Fig. 7. — The median temperature (in °K) of gas with density pb (in units of the mean gas density) 
at z = 2 for the SCDM simulation (sohd line) and the ACDM simulation (dotted line). 

temperature is not determined by photoionization equilibrium alone, but it depends on the 
initial temperature which the gas acquired when it was reionized (Miralda-Escude & Rees 
1994). Since the cooling time of the gas at low densities is longer than the Hubble time, 
the gas retains a memory of these initial conditions. In the SPH simulation of the SCDM 
model, the ionization is turned on at z = 6 and the gas is assumed to be immediately 
ionized, but no heat is included (the gas is only heated subsequently at the rate determined 
assuming photoionization equilibrium). On the other hand, in the Eulerian simulation 
of the ACDM model, initial heat from the reionization is included; in fact, helium was 
doubly ionized at z ~ 3 in this simulation (as a result of the relatively soft spectrum that 
was assumed for the emitting sources), and this resulted in an additional heating rate 
for low-density gas that was absent in the SPH simulation. The result of these different 
assumptions about reionization heating that were made in the two models is that in the 
Eulerian simulation the gas temperature in the regions with p/p ^1 is significantly higher 
than in the SPH simulation, and this difference in temperature increases as the density 
decreases. Thus, the contribution to the average flux decrement from low density regions 
in the SPH simulation is enhanced due to the higher recombination coefficient relative 
to the Eulerian one. Therefore, if the two simulations had made the same assumptions 
on the heat deposited by reionization, the changes in the distribution of optical depths 
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Fig. 8. — The rms mass fluctuation in spheres of comoving radius Rh^^ Mpc, computed from the 
Unear theory power spectra of the SCDM model (solid line) and the ACDM model (dotted line) at 



in Figure |5| would improve the agreement. We see that even the small difference found 
between the two models is probably not related to the different cosmological models per 
se, but is explained in large part by this difference in the gas temperature, which arises 
from the differing treatments of reionization. 

The contribution of various physical effects to predictions for the FDDF will be 
examined in greater detail in other papers (Weinberg et al. 1997). Here, our main 
conclusion is that the two models we have examined appear to explain the observed flux 
distribution satisfactorily, and therefore we can use them to obtain the parameter fi, which 
can provide us with new constraints on the cosmic baryon density and the intensity of the 
ionizing background. 

It is worth noting that the similarity in the FDDF predictions of these two cosmological 
models is somewhat coincidental; they predict similar nonlinear structure on the relevant 
scales at z ~ 2 — 4, but some other popular theories of structure formation would not. 
Figure ^ shows the rms mass fluctuation as a function of comoving scale (tophat sphere 
radius R /i~^Mpc), computed from the linear theory power spectra of the two models 
at z = 2. The two models have quite similar mass fluctuation spectra on the scales 



-20- 



represented in these simulations, and the rms fluctuation amphtude is almost identical on 

the comoving scale i? ~ 1 Mpc that is probably most relevant to the Lya forest at 
this rcdshift. However, the rms fluctuation at 1 Mpc for a COBE-normalized standard 
CDM model (with = 1, n = 1, h = 0.5) would be higher by about 70%, and it would be 
lower by about 30% for a tilted CDM model (with n = 0.8, Q = 1, h = 0.5, as = 0.55) and 
lower by more than a factor of two for a cold+hot dark matter model with = 0.2 (see 
flgure 4 of Liddle et al. 1996). These differences might well lead to signiflcant departures 
from the observed FDDF, though detailed analysis of these models will be required to see 
whether they are ruled out given the freedom to adjust fi and the uncertainties in the 
appropriate treatment of reionization (and in the resultant gas temperatures). 

4. Observational Constraints on the Intensity of the Ionizing Background 

We now proceed with examining independent constraints that we have on the intensity 
of the ionizing background at high redshift (or, equivalently, the photoionization rate F), 
which we can then combine with our determination of the parameter fj, to obtain limits on 

There are several ways to measure observationally the intensity of the ionizing 
background at high redshift. In this paper, we are particularly interested in obtaining a 
flrm lower limit to this intensity, J. As we have argued above, this leads to an interesting 
lower limit to the baryon density Q^. The best way to obtain a lower limit to J is to 
calculate the intensity from the observed number of sources and absorbers of ionizing 
photons. An important point here is that, in principle, the observation of the number 
of sources and absorbers determines the intensity of the background at all redshifts 
independently of the cosmological model and any other assumptions. This point becomes 
obvious by noticing that the background intensity would not change if photons were emitted 
homogeneously in space, rather than from individual sources; thus, only the average 
surface brightness from sources in a given redshift interval matters for the calculation 
of the background, and the surface brightness always varies as (1 + z)^. Similarly, the 
absorption on the background depends only on the average number of absorbers of a given 
optical depth per unit redshift along the line of sight, which is also directly observed. 

Let us express this directly using the equation for the evolution of a cosmic background 
of proper intensity J{u,z)du at frequency u and redshift z (e.g., Peebles 1971), 



Here, j£:(i^) is the proper emissivity (energy emitted per unit time, volume and frequency). 
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K is the opacity, and H{z) is the Hubble constant at redshift z. If (j){L, z) is the comoving 
luminosity function of sources (i.e., the number of sources per unit comoving volume 
having a certain luminosity) at redshift z, we have Je = (1 + z)^ J dL(l){L) L. The observed 
flux per unit frequency from a given source is F{v) =L[i/(l + z)](l + z)/(47rDf), where A 
is the luminosity distance. The observed total number of sources over the sky at redshift z 
and flux F is related to the luminosity function by 

Ns{z,F)dzdF = ^{L)^^^{l + z) f-^) dzdL . (6) 

(1 + zY \ dz J 

Finally, using H = —dz/dt/{\ + z), we obtain 

The quantity Je is the one that is independent of the cosmological model and is determined 
by the observations of N^, and determines also the evolution of J through equation (^). 

We can obtain the quantity Je from the results of various quasar surveys that have 
been published. We use the results on the quasar luminosity function of Warren, Hewett, 
& Osmer (1994; their Table 4), hereafter WHO, and Hartwick & Schade (1990; their 
Table 5), hereafter HS. We add up the contribution to je from each bin in luminosity of 
the luminosity function given in these tables, and use eq. (2) in WHO, and the relation 
Mb = Mq — 0.605 (see Pei 1995, for the model with spectral index a = —0.5 between the 
blue band and Lya line wavelengths) to transform the absolute magnitudes given in these 
papers to a continuum flux per unit frequency at the Lya wavelength. We then multiply 
this flux by a factor (4/3) to transform to the flux per unit frequency at the Lyman 
limit, assuming a spectral index a = 1.5 between the Lya and Lyman limit frequencies 
(see, e.g., Laor et al. 1994). Table 3 shows the values derived for Je{t^) at the Lyman 
limit, in the customary units of 10~^^ erg cm^^ s"^ sr~^ Hz^^ , for two redshifts from 
WHO (we have used their comoving luminosity functions in the intervals 2 < z < 2.2, and 
2.2 < z < 3.0, for calculating at z = 2 and z = 3, respectively), and for z = 2 from 
Hartwick &; Schade (where we use their luminosity function in the interval 1.9 < z < 2.2). 
The errorbars for Je were obtained from the number of quasars from which the luminosity 
function was derived in each luminosity bin. We also give the result derived from the 
model of Pei (1995), which was used by Haardt & Madau (1996, hereafter HM) to calculate 
the evolution of the ionizing background. 

We notice that Je derived from the luminosity functions of WHO and HS agree with 
each other, but are lower by a factor 2 — 3 compared to the model in Pei (1995). The 
reason for this is that the model by Pei was a fit to the observed luminosity function which 
assumes (j){L) oc L~^'^^ at low luminosities (for the model used in HM), and therefore the 
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contribution to the emissivity converges only as L"'^"^. Since the value of the luminosity 
below which (f){L) has this slope is not much higher than the faintest quasars in the 
observed samples at z > 2, a large fraction of the emissivity in the model by Pei comes 
from quasars that have not been observed, but are only assumed to exist in the model. One 
should also notice that the luminosity function of HS extends to 0.6 magnitudes fainter 
than in WHO. While the extrapolation of the luminosity function in Pei (1995) to fainter 
quasars than observed is reasonable, based on the luminosity function observed at lower 
redshifts, we cannot rely on it to obtain a firm lower limit to Je- The values obtained 
by adding the contribution only from observed quasars should be used as a lower limit, 
although the value from the model of Pei should be considered as a more probable one. A 
considerably larger value of Je is always possible if sources of ionizing radiation different 
from quasars are significant. 

HM derived the value of J, essentially using equation (^) but including absorbing 
clouds as sources in Je as well, using the model of Pei for Je- To obtain a firm lower 
limit on J, we notice that if Je is decreased by a constant factor at all redshifts J will 
decrease by the same factor. This is strictly correct as long as k is not altered, as seen from 
equation (P). In the model of Pei, the comoving density of quasars is assumed to decline 
at z > 3.5, so the contribution from quasars above this redshift to the intensity J at z = 2 
is negligible (especially because of the increase of absorption by Lyman limit systems at 
these redshifts). Thus, the value of J cannot be significantly decreased by increasing the 
rate of decline of quasars at high redshift, while being consistent with the observational 
evidence that any decline of the quasar density is not significant below z ~ 3.5. 

The only other possibility there is for reducing the value of J is to increase the 
absorption k. The calculation of HM included the effect of absorption from a model of 
the number of absorbers given by their equation (7), which implies a number of Lyman 



Table 3. Emissivities 
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Redshift 


Je 


WHO 


2 


1.50 ± 0.22 


HS 


2 


1.86 ± 0.69 


Pei 


2 


3.27 


WHO 


3 


2.92 ± 0.72 


Pel 


3 


7.09 
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limit systems per unit redshift (with A'hi > 1-59 x lO^'^'cm"^) equal to 1.5[(1 + z)/3]^'^. 
The observational determinations are consistent with this number and are accurate 
to within ~ 20% (Sargent, Steidel, & Boksenberg 1989; Storrie-Lombardi et al. 1994; 
Stengler-Larrea et al. 1995); since the absorption is dominated by Lyman limit systems, it 
does not seem that absorption could be significantly increased above the model used by 
HM. The reemission of radiation from the absorbing clouds was also included in HM, and 
this resulted in a substantial increase in the derived value of J. The calculation of this 
reemission is also model-independent and depends only on the observed column density 
distribution of the absorbers, since the only assumption that is made to infer the emission 
from clouds is that they are in ionization equilibrium. This assumption is correct, because 
the time to reach ionization equilibrium depends only on J and is of order ~ 3 x 10^ yr. 
Thus, the inclusion of the reemission from clouds to obtain a lower limit to J is warranted. 

HM obtained a value for the photoionization rate at z = 2, F = 1.4 x 10~^^ sec~^ (see 
their Figure 6). From Table 3, our lower limit to Je (taken from the average of WHO and 
HS) is a factor of 2 below that in the Pei model used in HM, so we infer 

F(z = 2) > 7 X lO^^^sec"^ . (8) 

This can also be expressed in terms of the cross-section-weighted background intensity (as 
defined in eq. [1] of Miralda-Escude et al. (1996)), Jhi > 1-6 x 10^^^ erg cm~^ s~^ sr^^ 
Hz~^ . For the HM spectrum this corresponds to an intensity Jg-^^X ^ ^'"^ ^ 10^^^ at the 
Lyman limit. 

One of the effects that can change the ionizing background intensity from quasars 
is the possibility that they are obscured by dust in intervening galaxies. However, it is 
simple to see that this can only result in an increase of J (see Miralda-Escude & Ostriker 
1990): the absorption from a quasar at z = Zq to us must on average be larger than from 
the same quasar to a point at < z < Zq, so the increase in Je due to the fact that we 
underestimate the number of quasars because they are obscured is more important than 
the reduction of J due to additional absorption. The observed fluxes from quasars can also 
be altered by gravitational lensing, but this does not affect the estimate of J contributed 
by quasars because the average surface brightness is conserved. 

We therefore conclude that our lower limit of eq.(|8|) is a strict one, not subject to 
systematic uncertainties other than any errors in the observational determination of the 
quasar luminosity function and the number of absorbers. 

Another method for measuring the intensity J is the proximity effect. Observations 
at intermediate redshift (Carswell et al. 1987; Bajtlik, Duncan & Ostriker 1988; Lu, Wolfe 
& Turnshek 1991; Bechtold 1994; Giallongo et al. 1996; Cooke et al. 1996) have arrived 
at values of J ° ~ 10~^^, but with a large scatter. The most recent high resolution 

912A ' ^ 
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studies by Giallongo et al. (1996) give J^-^^^ = (5 ± 1) x 10 obtained for a redshift 
range z=l. 7-4.1, and Cooke et al. find (lOlg l) x 10~^^ for a similar z range. However, 
the proximity effect is subject to several systematic uncertainties; in particular, J could be 
underestimated if the luminosity of quasars is highly variable over the ionization timescale 
of 3 X 10^ yr, and also if most of the quasars with good spectra (which are naturally the 
brightest ones) are magnified by gravitational lensing. In addition, the number of clouds 
near quasars might be enhanced due to clustering, partially cancelling the reduction due 
to the higher intensity of photons. It is difficult to estimate how large these effects could 
be, so the proximity effect cannot be used to obtain a firm lower limit to J. Nevertheless, 
the fact that all the estimates are higher by factors of 2 to 20 compared to our lower limit 
from the number of observed quasars is reassuring. 

An independent, rough estimate of J^-^^^ can also be derived from the degree 
of ionization needed to reproduce the column density ratios of various metal ions in 
intervening heavy element absorption systems. SCDM simulations specifically adressing 
such higher column density systems (Ranch, Haehnelt, & Steinmetz 1996) have shown that 
at z ~3 a HM spectrum with an intensity J ° = 3 x 10~^^ matches well the observed 

^ 912A 
ratios of several common metal ions (for a uniformly metal enriched gas with Z=10 0, 

Of,/i^ = 0.018 ). Hellsten et al. (1997) have confirmed this result for the SCDM simulation 

described here. Again, this is fully consistent with our lower limit. 



5. Discussion 

5.1. The lower limit to the cosmic baryon density 

With the lower limit on T we immediately obtain a lower limit for ^l^, using the 
constraints from the simulations. Our lower limit for T is applicable at redshifts z = 2 and 
3, since this is the redshift range where the sources have been observed and the models 
are consistent with an approximately constant intensity contributed by the known sources 
(see HM). The constraints for any changes in T when going to z = 4 are relatively poor, 
because of the small number of known quasars at this high redshift. In Table 4, we give 
the values of the parameter (eq. ^ ) derived from our fits to the FDDF in Section 3 at 
each redshift and for the two models. The limits on Q^h"^ assuming F > 7 x 10~^^ sec~^, as 
required from the two simulations, are given in the fourth and fifth column. 

In Figure |9|, we plot these same limits together with the 95% confidence limits from 
Hata et al. (1996) for the derived for the cases of a "low" and a "high" D/H ratio 
recently discussed in the literature, and for a standard big bang model with solar system 
D and ^He abundances. On the basis of profile fits to DI and HI Lya absorption lines of 
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Fig. 9. — Lower limits to Ofc/i^ assuming F > 7xl0~^^ s~^. The region between the dashed lines is 

the 95% confidence area for the "low D/H" value as derived by Hata et al. (1996). The dotted lines 
show the corresponding lower and upper limits for the "high D/H" value, and the dash-dotted lines 
give the value consistent with solar system D and ^He abundances, according to the same source. 
Note that the nucleosynthesis constraints measure Ofe/i^, whereas our method gives Ofe/i^/^. 

intermediate column density systems at high redshift, Songaila et al. (1994), Carswell et 
al. (1994), and Rugers &: Hogan ( 1996a, b) reported a high D/H ratio, whereas Tytler, Fan, 
&; Buries (1996) and Buries &: Tytler (1996) favored a low D/H ratio as representative 
of the universal deuterium abundance. If the simulations are correct, the low 11 ^ value 
(corresponding to the high D /H) is not consistent with the higher values we obtain here for 
the two CDM models. The range for solar system abundances, and the lower D/H value 
(Tytler, Fan & Buries 1996) are fully consistent, as our measurements are lower limits to 

The obvious question that should be asked here is if other cosmological models of 
the Lya forest might require a much lower value for the parameter // to fit the observed 
FDDF, while still predicting satisfactorily the observed characteristics of the Lya forest. 
As discussed in Miralda-Escude et al. (1996), in order for that to be possible, the physical 
structures giving rise to the Lya absorption systems of a fixed, observed neutral hydrogen 
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column density would need to be much denser than they are in the simulations we have 
examined here, while still producing lines of the same velocity width (and hence equivalent 
width). To clarify this argument, we shall give an analogous one here that will focus on 
the distribution of the flux decrement rather than the number of absorption lines with 
fixed column density. 

Let /(r) dr be the optical depth probability density, i.e., the fraction of the Lya forest 
spectrum where the optical depth is in the range t to t + dr. Since /(r) is related to the 
FDDF in a straightforward way, we know that our simulations reproduce reasonably the 
form of /(t). Now, consider the spatial regions in the simulation that yield optical depth r 
to T + dr in the Lya spectrum, and let fr{T) dr be the fraction of the spatial volume filled 
by these regions. The average optical depth contributed by such regions is: 

T f{T)dT (X n{p/pf a{T) fr{T)dT (X fi{p/p)a{T) fb{T)dT , (9) 

where p/p and a(T) are the overdensity and the recombination coefficient in the regions 
that give optical depth r, and /(((r) = fr{T)[p/p) is the fraction of baryons in these regions. 
One should notice that, in general, the optical depth at a given point in the Lya spectrum 
will not come from a unique point in space, but from a finite region, owing to the effects of 
thermal broadening and velocity caustics; at the same time, regions yielding certain optical 
depths will have a distribution of densities and temperatures. But for the purpose of the 
present argument, the density and temperature in equation (^ should be understood as a 
representative value for the gas that contributes to optical depths r. 

We see from equation (P) that, if p were to be lower than the value we found from our 
two simulations (to allow for a smaller ^b)-, then either a larger fraction of baryons ought to 
be in the intergalactic gas producing the Lya forest, or the overdensities of the structures 
should be higher, or the temperatures should be lower to increase the recombination 
coefficient. The ffist possibility cannot make a large difference, because most of the baryons 
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in our simulations are already in the Lya forest (Miralda-Escude et al. 1996, 1997). The 
inferred fi also cannot be significantly decreased by having a lower temperature of the gas, 
because in the SPH simulation the gas temperature in low density regions is already as low 
as possible. No energy input from reionization was included in this simulation, and the 
temperature is then determined by the balance between adiabatic cooling and the heating 
from photoionization (with other cooling terms being less important), and it does not 
depend on the model for structure formation. This minimum temperature is approximately 
proportional to ['[lhh{z)]^'^ , as will be explained in more detail in Miralda-Escude et al. 
(1997). The increase of temperature with fib tends to strengthen our lower limit to Qf,, 
since we have assumed that r oc while, in the case where reionization heat input is 
small as in the SCDM simulation, the effective dependence is shallower (Croft et al. 1997; 
Miralda-Escude et al. 1997). 

The difference in temperature is in fact the primary reason that the SCDM model 
yields a lower value of the parameter /i compared to the ACDM model: most of the 
increase of the mean decrement as the parameter /i is increased comes from unsaturated 
absorption arising from regions with 0.3 < p/p < 1, where the difference in temperature is 
a factor ~ 3, implying a difference in the recombination coefficient of a factor 2, similar to 
the difference between the p parameters in the two models from Table 4. 

This leaves only the possibility that the structures yielding the observed Lya forest 
absorption are more overdense than predicted in our simulations. That is to say, if we fix 
the optical depth r, the absorption that fills a fraction of the spectrum f{T)dT determined 
observationally must arise from gas with higher densities than in the simulation, and 
therefore also with smaller filling factors frij) in real space. We notice that, since // tx f]^, 
and the absorption is proportional to n{p/p) when /;,(t) is fixed (from eq. ||9|), then in order 
to decrease our lower limit to 0;, by a factor of 2, the overdensities of Lya absorbers with 
a fixed baryon content should be larger by a factor of 4 compared to our model. Since the 
shape of the FDDF needs to be preserved, this increase in density would have to be rather 
homogeneous for all the gas giving rise to different optical depths. It is difficult to see 
how this could be achieved unless we were to return to a picture of separate clouds, and 
an "intercloud medium" which does not make a significant contribution to the observed 
absorption. 

Given this argument, we believe that the lower limit we obtain here on fif, is unlikely 
to be much weaker in other cosmological models, at least if they remain consistent with 
the observed FDDF. Indeed, we have found that the difference in the values of /x inferred 
from the two models reflects the difference in the temperature of the low-density gas in 
the two simulations, which is a consequence of the treatment of reionization rather than 
a consequence of the cosmological models per se. If, as argued above, the temperature of 
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the low-density gas cannot be lower than in the SPH simulation, then our lower limit is 
rife/i^ > 0.017, from Table 4 (we do not consider the z = 4 lower limit reliable because of 
the more uncertain value of F). If we accept that /i cannot be lowered below the value in 
this model, we can still reduce the inferred ilh in a model where H(z) is as low as possible. 
If we take Ho > 50kms~^ Mpc, and consider the A model to minimize the increase of H{z) 
with redshift, with CI > 0.3 to satisfy constraints from large-scale structure (e.g., Dekel & 
Rees 1994), we can reduce H{z = 2) by a factor 0.57 relative to the SCDM model, which 
would bring down our lower limit to Qf,h'^ > 0.012. Even with all parameters pushed to 
their limits, this is still inconsistent with the high deuterium measurements. 

Croft et al. (1997) have recently studied HI and Hell Lya absorption in SPH 
simulations of several cosmological models, including the SCDM simulation analyzed here, 
an open CDM model with Qq = 0.4, and a COBE-normalized, $7 = 1 CDM model with 
(Tg = 1.2 (instead of the as = 0.7 as adopted for the SCDM model). The open model has 
a similar amplitude of fluctuations on the Lya forest scales at z ~ 2 — 3 (~ lh~^ Mpc), 
so not surprisingly the results for the parameter /x and for the flux distribution function 
are similar to the SCDM model. On the other hand, the CDM model with cjg = 1.2 has a 
higher amplitude of fluctuations, leading to a wider density distribution: more of the gas in 
this model has collapsed into high density regions producing saturated absorption, and less 
gas remains in the low and intermediate density regions giving the unsaturated absorption. 
As a result, this model requires a higher value of fi to match the observations, i.e., a larger 
Oft. The predicted FDDF is also correspondingly broader (see Croft ct al. , figure 11), 
perhaps at a level that could be ruled out by comparison to the FDDF measured here. In 
order to weaken our lower bound on ilt, one would want a cosmological model with a lower 
mass fluctuation amplitude than the SCDM or ACDM models, as these would leave a 
larger fraction of their gas in unsaturated regions. Such models certainly exist (tilted CDM 
or cold-|-hot dark matter, for example), but it does not seem likely that the fluctuations 
in the IGM can be reduced greatly without spoiling agreement with the FDDF. These 
models would also risk conflict with the number of observed damped Lya systems (Katz et 
al. 1996; Gardner ct al. 1997). The exact constraints given on the models by the observed 
FDDF, the damped Lya systems, and other observables of the Lya forest such as the 
Doppler parameters, together with the allowed variations on the minimum value of the 
parameter fj, required to reproduce the observed mean decrement, will be investigated in 
more detail in future work. 
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Fig. 10. — Redshift dependence of the ionization rate T, adopting a constant ilbh^ =0.024 (the 
value given by Buries & Tytler 1996). The dash-dotted line connects two estimates for F by Haardt 
& Madau (1996), based on the expected contribution from QSOs alone. The steep drop of their 
estimate towards z=4 and the near constancy of the ionization rate required by our measurement 
indicate that additional sources of ionization other than the known QSOs dominate beyond z~ 4. 



5.2. The evolution of the ionizing background 

The variation of the parameter fi with redshift can be used to determine the evolution 
required for the intensity of the ionizing background, or the photoionization rate T{z). For 
this purpose, we choose ilfe/i^ = 0.024 to fix the normalization of T{z), which is consistent 
with the deuterium measurements by Tytler et al. (1996). The inferred photoionization 



rates are shown for the two models in Figure 10. The intensity is almost constant, with a 
slight decline with redshift required for the ACDM model. This finding is consistent with 
measurements from the proximity effect, where there is observational evidence for a small 
decrease in the intensity above redshift 4 (Williger et al. 1994; Lu et al. 1996). The values 
of r_i2 as a function of redshift are listed in Table 4. 
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Comparing to the model in HM for the intensity derived from the observed quasar 
luminosity function and number of absorbers, we see that the intensity is in good agreement 
at 2: = 2 and z = 3. It is therefore remarkable that if the deuterium measurement of Tytler 
et al. (1996) is correct, then the simulations predict the same value of T as expected from 
the observed sources of ionizing photons. Since Clt, cannot be substantially larger than 
the value assumed here if primordial nucleosynthesis is correct (because even allowing for 
a large systematic error in the ^He abundance, the solar system deuterium abundance 
would then be in conflict with the theory), our simulations then imply that sources other 
than the observed quasars cannot contribute significantly to r(2;), at rcdshifts up to three. 
On the other hand, the decline of T at 2; = 4 in the HM model is not indicated by our 
measurement. Therefore, our models predict that sources of ionizing photons other than 
just the known QSOs should be present at z ;^ 4 to account for the cosmic background. 
The additional emission of photons might come from other quasars that have not yet been 
identified, or from star-forming galaxies. An alternative possibility is that, for z 4, 
absorption by dust in intervening galaxies reduces the flux from quasars seen at z = 
(used in the HM computation of F) relative to the flux seen by the IGM at z ~ 4 (Heisler 
& Ostriker 1988; Miralda-Escude & Ostriker 1990). 

6. Conclusions 

Hydrodynamical simulations of hierarchical structure formation at high redshift have 
now reached a degree of realism enabling us to determine cosmological parameters from 
a comparison of the simulated HI distribution with observational data about the Lya 
forest. Here we have compared the distribution of flux decrements in simulations and 
observations, and we have measured the quantity (il^hh'^)'^ /[TH{z)] by scaling the optical 
depth distribution of the simulated Lya forest spectra such as to match the mean flux 
decrement D in the observed data. As a first result we find that, in spite of some individual 
differences, both a ACDM model (Cen et al. 1994; Miralda-Escude et al. 1996) and a 
standard CDM model (Hernquist et al. 1996) are able to reproduce the basic shape of the 
cumulative flux decrement distribution function well. Although not a proof, this gives 
additional support to hierarchical structure formation as the process that leads to the 
distribution of the baryonic density and temperature in the universe as manifested in QSO 
absorption spectra. This result is robust to the uncertainty in the allowed cosmological 
model within the range tested here, though other cosmological models that predict 
substantially different high-redshift structure may eventually be ruled out by comparison 
to the observed FDDF. 



To measure Qf, separately we have estimated the ionizing background radiation from 
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the UV intensity produced by the known QSOs alone. The inferred ionization rate of 

neutral hydrogen, F > 7 x 10~^^ s~^, is a strict lower limit and is consistent with the lower 
range of the intensities determined from the proximity effect in the Lyct forest near QSOs. 
The lower limit on T then translates into a lower limit on Oft/i^/^. The limits obtained from 
the two simulations are different by a factor ~ 1.5, but we have shown that most of this 
difference is related to the different temperature of the low-density gas in the simulations. 
After considering the uncertainty in this temperature, as well as the uncertainty in the 
Hubble constant, we arrive at a lower limit Qi,h'^ > 0.012. As wc have discussed, this lower 
limit might be reduced in models with a lower amplitude of density fluctuations, but it 
is doubtful that such models would also agree with the observed distribution of the flux 
decrement, and that they would be able to reproduce the observed mass of baryons in the 
damped Lya systems. 

When we take the best estimate from the models of HM for T contributed by known 
QSOs, r ~ 1.4 X 10~^^ s~^ (rather than the above lower limit), our inferred value of 
Uf, for the two models we have examined is consistent with the value implied by the 
deuterium abundance measurement by Tytler et al. (1996), whereas our lower limit to 
is inconsistent with the much higher deuterium values found by others (Rugers &: Hogan 
1996a,b and references therein). We also conclude from this result that any other sources of 
UV photons at high redshift could not increase the value of T to more than ~ 3 x 10~^^ s~^, 
because the very large fib that would then be implied would be inconsistent with primordial 
nucleosynthesis, given the Solar System deuterium abundance. 

Prom the redshift dependence of the parameter /x in our two models, we can also infer 
the required evolution of F. We derive an approximately constant value from z = 2 to 
z = 4:, which is in agreement with the recent measurements of the proximity effect. The 
decrease of T between z = 3 and z = 4 expected if the ionizing background were produced 
solely by the known population of QSOs (see HM) is not observed, indicating the presence 
of additional sources of ionizing radiation, e.g., QSOs undetected in present surveys or 
obscured by intervening dust, or young stars in forming galaxies. 
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